On the Convergence Error in Loopy Propagation
نویسندگان
چکیده
Reasoning with a Bayesian network amounts to computing probability distributions for the network’s variables. Pearl’s propagation algorithm provides for efficient reasoning with singly connected networks. When applied to a multiply connected network, the algorithm no longer yields exact probabilities, yet has been reported to result in good approximations. In this paper we provide some theoretical background to the algorithm’s performance on multiply connected networks. We indicate the two types of error that can arise in the probabilities computed by the algorithm and analyse the different factors that govern one of these errors.
منابع مشابه
Loopy belief propagation for approximate inference : an empiricalstudyKevin
Recently, a number of researchers have demonstrated excellent performance by using \loopy belief propagation" | using Pearl's polytree algorithm in a Bayesian network with loops. The most dramatic instance is the near Shannon-limit performance of \Turbo Codes" | error-correcting codes whose decoding algorithm is equivalent to loopy belief propagation. In this paper we ask: is there something sp...
متن کاملMessage Error Analysis of Loopy Belief Propagation for the Sum-Product Algorithm
Belief propagation is known to perform extremely well in many practical statistical inference and learning problems using graphical models, even in the presence of multiple loops. The use of the belief propagation algorithm on graphical models with loops is referred to as Loopy Belief Propagation (LBP). Various sufficient conditions for convergence of LBP have been presented; however, general n...
متن کاملLoopy Propagation: the Convergence Error in Markov Networks
Loopy propagation provides for approximate reasoning with Bayesian networks. In previous research, we distinguished between two different types of error in the probabilities yielded by the algorithm; the cycling error and the convergence error. Other researchers analysed an equivalent algorithm for pairwise Markov networks. For such networks with just a simple loop, a relationship between the e...
متن کاملSufficient Conditions for Convergence of Loopy Belief Propagation
We derive novel sufficient conditions for convergence of Loopy Belief Propagation (also known as the Sum-Product algorithm) to a unique fixed point. Our results improve upon previously known conditions. For binary variables with (anti-)ferromagnetic interactions, our conditions seem to be sharp.
متن کاملLoopy Belief Propagation: Convergence and Effects of Message Errors
Belief propagation (BP) is an increasingly popular method of performing approximate inference on arbitrary graphical models. At times, even further approximations are required, whether due to quantization of the messages or model parameters, from other simplified message or model representations, or from stochastic approximation methods. The introduction of such errors into the BP message compu...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2005